Skip to content

[GLUTEN-9615][INFRA] Automate release process with build script and GHA workflow#10807

Merged
zhouyuan merged 7 commits intoapache:mainfrom
PHILO-HE:release-build-script
Oct 1, 2025
Merged

[GLUTEN-9615][INFRA] Automate release process with build script and GHA workflow#10807
zhouyuan merged 7 commits intoapache:mainfrom
PHILO-HE:release-build-script

Conversation

@PHILO-HE
Copy link
Member

@PHILO-HE PHILO-HE commented Sep 26, 2025

What changes are proposed in this pull request?

Use GHA to build Gluten jars for supported Spark versions, which can simplify the release process and ensure all required build options are enabled, avoiding potential omissions in manual builds.

Will backport it to branch-1.5 to help the coming 1.5.0 release.

How was this patch tested?

@PHILO-HE PHILO-HE force-pushed the release-build-script branch from 343a2b3 to 7261156 Compare September 26, 2025 03:10
@PHILO-HE
Copy link
Member Author

PHILO-HE commented Sep 26, 2025

If iceberg support is enabled, Java 11 is required as the minimum version for Gluten Spark 3.4 build, due to the use of iceberg 1.7.1.

Error:  Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.12.1:compile (default-compile) on project gluten-iceberg: Compilation failure
Error:  /workspace/gluten-iceberg/src/main/java/org/apache/gluten/substrait/rel/IcebergLocalFilesBuilder.java:[19,25] error: cannot access DeleteFile
Error:    bad class file: /root/.m2/repository/org/apache/iceberg/iceberg-spark-runtime-3.4_2.12/1.7.1/iceberg-spark-runtime-3.4_2.12-1.7.1.jar(org/apache/iceberg/DeleteFile.class)
Error:      class file has wrong version 55.0, should be 52.0
Error:      Please remove or make sure it appears in the correct subdirectory of the classpath.

@PHILO-HE PHILO-HE force-pushed the release-build-script branch 2 times, most recently from 04c6a51 to 7d7d5e0 Compare September 26, 2025 14:47
@PHILO-HE PHILO-HE force-pushed the release-build-script branch from 7d7d5e0 to 60bda0d Compare September 26, 2025 14:58
pull_request:
paths:
- '.github/workflows/build_release.yml'
# push:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this PR under testing?
Should try to enable this code by using a tag creation.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's for testing. Will be reverted to only trigger the build when new release tag is created.

@PHILO-HE PHILO-HE force-pushed the release-build-script branch 2 times, most recently from b5e1a35 to 4e9aa8f Compare September 30, 2025 16:52
@PHILO-HE PHILO-HE force-pushed the release-build-script branch from 4e9aa8f to faec8d1 Compare September 30, 2025 16:57
This reverts commit 6e93b6c.
@PHILO-HE PHILO-HE marked this pull request as ready for review September 30, 2025 17:13
@PHILO-HE
Copy link
Member Author

@zhouyuan, could you review this pr? Thanks.

Copy link
Member

@zhouyuan zhouyuan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@zhouyuan
Copy link
Member

zhouyuan commented Oct 1, 2025

Should we also add a script for the source package release as apache required?
I also find some ref scripts from arrow and comet:
https://github.com/apache/arrow-rs/tree/main/dev/release
https://github.com/apache/datafusion-comet/tree/main/dev/release

@zhouyuan zhouyuan changed the title [INFRA] Automate release process with build script and GHA workflow [GLUTEN-9615][INFRA] Automate release process with build script and GHA workflow Oct 1, 2025
@github-actions
Copy link

github-actions bot commented Oct 1, 2025

#9615

@zhouyuan zhouyuan merged commit be0bdb5 into apache:main Oct 1, 2025
56 of 57 checks passed
PHILO-HE added a commit to PHILO-HE/gluten that referenced this pull request Oct 1, 2025
…HA workflow (apache#10807)

Use GHA to build Gluten jars for supported Spark versions, which can simplify the release process and ensure all required build options are enabled, avoiding potential omissions in manual builds.
PHILO-HE added a commit that referenced this pull request Oct 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants